US008842761B2 


d2) United States Patent 

Barsoum et al. 


(io) Patent No.: US 8,842,761 B2 

( 45 ) Date of Patent: Sep. 23, 2014 


(54) 

METHODOLOGY AND METHOD AND 
APPARATUS FOR SIGNALING WITH 
CAPACITY OPTIMIZED CONSTELLATIONS 

(75) 

Inventors: 

Maged F. Barsoum, Saratoga, CA (US); 
Christopher R. Jones, Pacific Palisades, 
CA (US) 

(73) 

Assignee: 

Constellation Designs, Inc., Pacific 
Palisades, CA (US) 

(*) 

Notice: 

Subject to any disclaimer, the term of this 
patent is extended or adjusted under 35 
U.S.C. 154(b) by 0 days. 

(21) 

Appl. No.: 

13/618,630 

(22) 

Filed: 

Sep. 14, 2012 

(65) 


Prior Publication Data 


US 2013/0083862 Al Apr. 4, 2013 

Related U.S. Application Data 


(63) Continuation of application No. 13/1 18,921, filed on 
May 31, 2011, now Pat. No. 8,270,511, which is a 
continuation of application No. 12/156,989, filed on 
Jun. 5, 2008, now Pat. No. 7,978,777. 


(60) 

Provisional application No. 60/933,319, filed on Jun. 
5, 2007. 

(51) 

Int. Cl. 



H04L 23/02 

(2006.01) 


H04L 27/36 

(2006.01) 


H04L 27/38 

(2006.01) 


H04L 27/04 

(2006.01) 


HO 3C 3/00 

(2006.01) 


H04L 1/00 

(2006.01) 


H04L 27/34 

(2006.01) 


H04B 15/00 

(2006.01) 

(52) 

U.S. Cl. 



CPC 

. II04I3 15/00 (2013.01); H04L 1/0003 


(2013.01); H04L 1/0009 (2013.01); H04L 
27/1405(2013.01) 


USPC 

.. 375/261; 375/298; 329/304; 332/103 


(58) Field of Classification Search 

USPC 375/259-262, 268, 269, 295, 298, 279, 


375/280, 329, 308, 316, 340, 341, 332; 

332/103; 329/304 

See application file for complete search history. 

(56) References Cited 

U.S. PATENT DOCUMENTS 

5,289,501 A 2/1994 Seshadri et al. 

5,862,179 A 1/1999 Goldstein et al. 

(Continued) 

FOREIGN PATENT DOCUMENTS 

EP 1578021 Al 9/2005 

EP 1971098 Al 9/2008 

(Continued) 

OTHER PUBLICATIONS 

Nuno Sout et al., “Iterative Turbo Multipath Interference Cancella- 
tion for WCDMA System with Non-Uniform Modulations,” IEEE, 
pp. 811-815,2005 * 

(Continued) 

Primary Examiner — Tesfaldet Bocure 
(74) Attorney \ Agent, or Firm — KPPB LLP 

(57) ABSTRACT 

Communication systems are described that use geometrically 
shaped constellations that have increased capacity compared 
to conventional constellations operating within a similar SNR 
band. In several embodiments, the geometrically shaped is 
optimized based upon a capacity measure such as parallel 
decoding capacity or joint capacity. In many embodiments, a 
capacity optimized geometrically shaped constellation can be 
used to replace a conventional constellation as part of a firm- 
ware upgrade to transmitters and receivers within a commu- 
nication system. In a number of embodiments, the geometri- 
cally shaped constellation is optimized for an Additive White 
Gaussian Noise channel or a fading channel. In numerous 
embodiments, the communication uses adaptive rate encod- 
ing and the location of points within the geometrically shaped 
constellation changes as the code rate changes. 

32 Claims, 44 Drawing Sheets 


Parallel Decoding Capacity 


User 

Bits 


Y 


Coder 


-3j Mapper 


AVVGN 

Channel 


/ Demapper 


- 4 . Decoder 


Received 
Bits 
» 



40 



US 8,842,761 B2 

Page 2 


(56) References Cited 

U.S. PATENT DOCUMENTS 


6,115,415 

A 

9/2000 

Goldstein et al. 


6,157,678 

A 

12/2000 

Wei 


6,603,801 

B1 

8/2003 

Andren et al. 


6,606,355 

B1 

8/2003 

Wei 


6,611,554 

B1 

8/2003 

Chouly et al. 


6,665,831 

B1 

12/2003 

Yoshida et al. 


7,245,666 

B1 

7/2007 

Gardner et al. 


7,376,203 

B2 

5/2008 

Brunei et al. 


7,620,067 

B2 

1 1/2009 

Niu et al. 


7,978,777 

B2 

7/2011 

Barsoum et al. 


8,265,175 

B2 

9/2012 

Barsoum et al. 


8,270,511 

B2 

9/2012 

Barsoum et al. 


2002/0044597 

Al* 

4/2002 

Shively et al 

.... 375/222 

2002/0106010 

Al 

8/2002 

Jones 


2003/0231715 

Al 

12/2003 

Shoemake 


2004/0022179 

Al 

2/2004 

Giannakis et al. 


2004/0066738 

Al 

4/2004 

Stopler 


2004/0161050 

Al* 

8/2004 

Larsson et al 

.... 375/267 

2004/0258177 

Al 

12/2004 

Shen et al. 


2005/0180531 

Al 

8/2005 

Wellig et al. 


2005/0207507 

Al 

9/2005 

Mitsutani 


2005/0276343 

Al 

12/2005 

Jones 


2005/0286409 

Al 

12/2005 

Yoon et al. 


2006/0045169 

Al 

3/2006 

Kim 


2006/0155843 

Al 

7/2006 

Glass et al. 


2007/0054614 

Al 

3/2007 

Walker et al. 


2007/0116161 

Al 

5/2007 

Tokoro et al. 


2007/0147530 

Al* 

6/2007 

Li 

.... 375/261 

2007/0280147 

Al 

12/2007 

Catreux-Erceg et al. 


2008/0200114 

Al* 

8/2008 

Eberlein et al 

... 455/3.02 

2009/0161786 

Al 

6/2009 

Nakagawa et al. 


2010/0195743 

Al 

8/2010 

Barsoum et al. 


2010/0303174 

Al 

12/2010 

Oh et al. 


2011/0228869 

Al 

9/2011 

Barsoum et al. 


2012/0147983 

Al 

6/2012 

Barsoum et al. 


2013/0170571 

Al 

7/2013 

Barsoum et al. 



FOREIGN PATENT DOCUMENTS 


WO 

9832257 Al 

7/1998 

WO 

2007074524 Al 

7/2007 

wo 

2008151308 Al 

12/2008 

wo 

2010078472 Al 

7/2010 


OTHER PUBLICATIONS 

Roalds Otnes et al. , “Adaptive Data Rate using ARQ and Nonuniform 
Constellations,” Vehicular Technology Conference, pp. 1211-1215, 
2001 * 

Fei Zesong et al., “Shaping Gain by Non-Uniform QAM Constella- 
tion with Binary Turbo Coded Modulation,” IEEE, pp. 1863-1867, 
2003 * 

Magged F. Barsoumet al., “Constellation Design via Capacity maxi- 
mization,” IEEE, pp. 1821-1825, 2007.* 

Frank et al., “Optimal Nonuniform Signaling for Gaussian Chan- 
nels,” IEEE, pp. 913-929, 1993.* 

Brendan Moor, “Pairwise optimization of modulation constellations 
for non-uniform sources Modulation,” Can. J. Elect. Computer Eng. 
vol. 34, pp. 167-177, 2009.* 

International Search Report for International Application No. PCT/ 
US2009/069881, Date Completed Apr. 12,2010, Date Mailed May 3, 
2010, 2 pgs. 

International Search Report for International Application No. PCT/ 
US2008/065994, Report Completed Oct. 3, 2008, mailed Oct. 22, 
2008, 2 pgs. 

Written Opinion for International Application No. PCT/US2008/ 
065994, Completed Oct. 3, 2008, Mailed Oct. 22, 2008, 5 pgs. 
Written Opinion of the International Searching Authority for Inter- 
national Application No. PCT/US2009/069881, Date Completed 
Apr. 13, 2010, Date Mailed May 3, 2010, 10 pgs. 

Agrell et al., “On the Optimality of the Binary Reflected Gray Code”, 
IEEE Transactions on Information Theory, Dec. 2004, vol. 50, No. 
12, pp. 3170-3182. 


Betts et al., “Performance of Nonuniform Constellations on the 
Gaussian Channel”, IEEE Transactions on Information Theory, Sep. 
1994, vol. 40, No. 5, pp. 1633-1638. 

Conway et al., “A Fast Encoding Method for Lattice Codes and 
Quantizers”, IEEE Transactions on Information Theory, Nov. 1983, 
vol. IT-29, No. 6, pp. 820-824. 

De Gaudenzi et al., “Performance Analysis of Turbo-Coded APSK 
Modulations Over Nonlinear Satellite Channels”, IEEE Transactions 
of Wireless Communications, Sep. 2006, vol. 5, No. 5, pp. 2396- 
2407. 

Forney, “Multidimensional Constellations — Part II: Voronoi Con- 
stellations”, IEEE Journal on Selected Areas in Communications, 
Aug. 1989, vol. 7, No. 6, pp. 941-958. 

Forney, Jr. et al ., “Efficient Modulation for Band-Limited Channels”, 
IEEE Journal on Selected Areas in Communications, Sep. 1984, vol. 
SAC-2, No. 5, pp. 632-647. 

Forney, Jr. et al., “Multidimensional Constellations — Part I: Intro- 
duction, Figures of Merit, and Generalized Cross Constellations”, 
IEEE Journal on Selected Areas in Communication, Aug. 1989, vol. 
7,No.6,pp. 877-892. 

Foschini et al., “Optimization of Two-Dimensional Signal Constel- 
lations in the Presence of Gaussian Noise”, IEEE Transactions on 
Communications, Jan. 1974, vol. Com-22, No. 1, pp. 28-38. 
Fragouli et al., “Turbo Codes with Non-Uniform QAM Constella- 
tions”, IEEE Int. Conf. Commun., Jun. 2001, pp. 70-73. 

Hamkins et al., “Asymptotically Dense Spherical Codes — Part II: 
Laminated Spherical Codes”, IEEE Transactions on Information 
Theory, Nov. 1997, vol. 43, No. 6, pp. 1786-1797. 

Hamkins et al., “Asymptotically Dense Spherical Codes — Part I: 
Wrapped Spherical Codes”, IEEE Transactions on Information 
Theory, Nov. 1997, vol. 43, No. 6, pp. 1774-1785. 

Makowski, “On the Optimality of Uniform Pulse Amplitude Modu- 
lation”, IEEE Transactions on information Theory, Dec. 2006, vol. 
52, No. 12, pp. 5546-5549. 

Milovanovic et al., “Simple Optimization Method of One-Dimen- 
sional M-PAM Constellations for the AWGN Channels”, 4th Inter- 
national Conference on Telecommunications in Modern Satellite, 
Cable and Broadcasting Services, Oct. 13-15, 1999, pp. 263-266. 
Muhammad et al., “Joint Optimization of Signal Constellation and 
Bit Labeling for Bit-Interleaved Coded Modulation with Iterative 
Decoding”, IEEE Communications Letters, Sep. 2005, vol. 9, No. 9, 
pp. 775-777. 

Raphaeli et al., “Constellation Shaping for Pragmatic Turbo-Coded 
Modulation with High Spectral Efficiency”, IEEE Transactions on 
Communications, Mar. 2004, vol. 52, No. 3, pp. 345-345. 
Ruotsalainen, “On the Construction of the Higher Dimensional Con- 
stellations”, IS1T 2000, Lausanne, Switzerland, Jun. 30-Jul. 5, 2002, 
p. 490. 

Sommer et al., “Signal Shaping by Non-Uniform QAM for AWGN 
Channels and Applications Using Turbo Coding”, ITG Conference 
on Source and Channel Coding, Jan. 2000, pp. 81-86. 

Sun et al., “Approaching Capacity by Equiprobable Signaling on the 
Gaussian Channel”, IEEE Transactions on Information Theory, Sep. 
1993, vol. 39, No. 5, pp. 1714-1716. 

Ungerboeck, “Channel Coding with Multilevel/Phase Signals”, 
IEEE Transactions on Information Theory, Jan. 1982, vol. IT-28, No. 
l,pp. 55-67. 

European Supplementary Search Report for Application No. EP 
08795885, International Filing Date Jun. 5, 2008, Search Completed 
Apr. 1, 2014, 8 pages. 

De Gaudenzi, Riccardo et al. “Performance Analysis ofTurbo-Coded 
APSK Modulations over Nonlinear Satellite Channels,” IEEE Trans- 
actions on Wireless Communications, vol. 5, No. 9, Sep. 6, 2006, pp. 
2396-2407, XP002457811, ISSN: 1536-1276, DOI: 10.1109/TWC. 
2006.1687763. 

De Gaudenzi, Riccardo et al., “Turbo-Coded APSK Modulations 
Design for Satellite Broadband Communications,” International 
Journal Satellite Communications and Networking, vol. 24, No. 4, 
Jul. 1, 2006, pp. 261-281, XP008134566, ISSN: 1542-0973, DOI: 
10.002/SAT.841. 



US 8,842,761 B2 

Page 3 


(56) References Cited 

OTHER PUBLICATIONS 

Sommer, Dirk et al., “Signal Shaping by Non-Uniform QAM for 
AWGN Channels and Applications Using Turbo Coding,” Proc. ITG 
Conf. Source and Channel Coding, Jan. 31, 2000, pp. 81-86, 
XP0551 10228. 


Zesong, Fei et al., “Shaping Gain by Non-Uniform QAM Constella- 
tion with Binary Turbo Coded Modulation,” 14th IEEE International 
Symposium on Personal, Indoor and Mobile Audio Communication 
Proceedings, Sep. 7-10, 2003, vol. 2, pp. 1863-1867, XP010678797, 
ISBN: 978-0-7803-7822-3. 

* cited by examiner 










Coder H Mapper H Modulator 


U.S. Patent 


Sep. 23, 2014 


Sheet 2 of 44 


US 8,842,761 B2 







Parallel Decoding Capacity 


U.S. Patent 


Sep. 23, 2014 


Sheet 3 of 44 


US 8,842,761 B2 




U.S. Patent 


Sep. 23, 2014 


Sheet 4 of 44 


US 8,842,761 B2 



Output Constellation 









Capacity 




optimized constellations 












U.S. Patent 


Sep. 23, 2014 


Sheet 10 of 44 


US 8,842,761 B2 



SNR(dB) 






U.S. Patent 


Sep. 23, 2014 


Sheet 13 of 44 


US 8,842,761 B2 



PAM 4 ep&assd fct patailei dec odi«§ capacity 



U.S. Patent 


Sep. 23, 2014 


Sheet 15 of 44 


US 8,842,761 B2 




U.S. Patent 


Sep. 23, 2014 


Sheet 16 of 44 


US 8,842,761 B2 





PAM § optim&etd icr pm cap - actfy 




PAMS opitaissg for paralfe; detoxing caps 



JS 8,842,761 B2 



FIG. 12d 



illations optimized for joint capacity at different rates 


U.S. Patent Sep. 23, 2014 Sheet 21 of 44 US 8,842,761 B2 



o 

rn 

0 O 

Ov 

a-, 

00 


o 

VO 

O 


— i 1 

’“H 

*r, 

o 

VO 

1 

>*ww| 

i 

o 

( 

d 

f 


o 

>!■!■!■!<! 


VQ 


<T) 

!>■ 

r~-» 

fO 

o 

vO 

VO 

0\ 




<n 

On. 

'O 


d 

o 

o 

© 

d 

O 



i i i 


o 


m 

CO' 

o 

fO 


o 

d 

GO 

vo 

p 

0 

O 

oo 

t> 

1 

d 

i 

T 

1 

o 

O 

d 


VO 

>n 

lO 

i.n 

>n 

*r> 

m 

VO 

o 


'O 

IO 

<0 

*n 

< r> 

l> 


o 

o 

d 

o 

© 

d 



i i i i 



vHM. 

>***< 

o 


o 

o 


00 

un 

in 

in 

in 

<n 

in co 


d 

d 

o 

d 

d 

d ~h 



ations optimized for parallel decoding capacity at different 


U.S. Patent 


Sep. 23, 2014 


Sheet 22 of 44 


US 8,842,761 B2 



CO 

o 

ro 

OS 

00 

© 

CO 

G\ 

DO 



Os 

so 

r“o 


in 

VO 

© 


i/S 


C i 

in, 



© 

© 



© 

© 




1 

1 

1 

1 







n 


f" 


GO 

CO 


O- 

*.n 


O 


v© 

C3S 

SO 

uo 

in 

rH 

Os 


JD 

ci 

Ed 

1 

o 

r i 

>4**^ 

© 

O 

© 

© 

00 











T““” 

m, 

o 

o 

n 

H 

n 

Cl 

ri 

cl 


Cl 

w 

ty 

00 

0 

VO 

VO 

O 

go 

© 

CD 


os 


o 

H 

o 

© 

© 

© 

© 



t 

1 


1 




i 

1 i 

© 

t‘ 

OJ 

VO 

SQ 

os 

Os 

VC 5 

VO 

Os 

O', 


to 

CO 

fO 

CO 

CO 

to 

CO 

CO 



•rT 

1 

"7 

© 




© 

W* 



O', 

o 

O 

o 

O 

CtD 

© 

© 



'<o 

o 

o 

o 

O 

O 

o 

© 

© 


© 

© 

1 

I 

1 





! ™ ( 






PAMJS optimized (or capacity 




PAM 16 optezsd fat kwtf cspaa 




RAMi€ apmms&d fe> par*i«i decesJtng capacity 


US 8,842,761 B2 





PAM IS optimised for p&sM capacity 




U.S. Patent sep.23,2014 sheet 27 of 44 


PAM-16 constellations optimized for joint capacity i 


(bps) 

1.5 

mm 

a s 

3.0 

3.5 

(SNR) 

8,52 

11.94 

1.5.25 

1S.60 

22.12 

;rc 

-2,02 

-1.96 

-1.91 

-1.85 

-1.76 

x.l 

-1.16 

-1.33 

-1.40 

-1.42 

-1.42 

■ J *2 

-1.16 

-1.10 

-1.05 

-1.10 

-1.15 


-0.90 

-0.69 

-0.82 

-0.84 

-0.90 


-0.34 

-0.69 

-0.60 

-0.62 

-0.68 


-0.34 

-0.40 

-0.43 

-0.43 

-0.47 

Z't 

-0.3 1 

-0.17 

-0.24 

-0.26 

-0.28 

>?•>. 
,v < 

-0.34 

-0.17 

-0.09 

-0.08 

-0.09 

X;x 

0.34 

0.17 

0.09 

0.08 

0.09 

.Xfj 

0.34 

0.17 

024 

0 26 

0.28 

x io 

0.34 

0.40 

0.43 

0.43 

0.47 

x;u 

0.34 

0.69 

0.60 

0.62 

D.6S 


0.90 

0.69 

0.82 

0.84 

0.90 

X]J 

1.16 

1.10 

1.05 

1.10 

1.15 

■'"14 

1.16 

1.33 

1.40 

1.42 

1.42 

XjJ 

2.02 

1.96 

1.91 

1.85 

1.76 


rib. 1 D3 


US 8,842,761 B2 


:t different ra tes 













U.S. Patent 


Sep. 23, 2014 


Sheet 28 of 44 


US 8,842,761 B2 


g capacity at catierenf 


(bps) 

(SNR) 

1,5 

2.0 

? S 

3.0 


9.00 

i 2 25 

1 5.42 

18.72 

22.13 

:>:•» 

-1.72 

-1 .98 

-1.89 

-1.84 

-1.75 


-1.72 

-1.29 

-1.56 

-1.12 

-1,42 


-0.81 

! .94 

1.89 

1.84 

1.75 

x% 

-0.81 

-1.17 

-1.14 

- 1.11 

-1.15 


1.72 

-038 

-0.35 

-0.40 

-0.47 


1 79 

-0.65 

-0.70 

-0.65 

-0.68 

% 

-0.62 

-0.38 

-0.34 

-0.29 

-0.28 

Xf 

-0.62 

-0.68 

-0.76 

-0.83 

-0.90 

Xfj 

0.62 

i .09 

1.13 

1.11 

1,15 

■rn 

0.62 

(1.76 

0.76 

0.84 

0.90 

*10 

0.02 

1.26 

135 

1.42 

1.42 

*1 1 

0.02 

0.76 

0.70 

0.65 

0.68 

«12 

0.81 

0,06 

0.00 

0.05 

0.09 

*13 

0.81 

0.29 

034 

0.29 

0.28 


-0.02 

0.06 

0.00 

-0.05 

-0.09 

;l'i5 

-0.02 

0,29 

035 

0.40 

0.47 


FIG. 15b 



JS 8,842,761 B2 



PMA 32 ?o? pm 



AM32 optimead for parage! dec«lB!g capa 





U.S. Patent 


Sep. 23, 2014 


Sheet 33 of 44 


US 8,842,761 B2 


PAM-32 constellations optimized for joint capacity at different rates 


(bps) 

2.0 

2.5 

3.0 

3,5 

4,0 

42 

SNR) 

11.83 

1 5.05 

1823 

21.42 

24.69 

28.19 

#0 

^2 25 

- 2.19 

- 2.14 

- 2.07 

- 1.97 

- 1.85 

A 

- 1.58 

-L?l 

- 1,74 

- 1.74 

5 "TA- 
“i > < M 

- 1.66 

;3:*2 

- 1.58 

- 1.46 

- 1,46 

- 3.49 

- 1.53 

- 1.50 


-no 

- 1,23 

- 1.27 

- 1.29 

-133 

- 1.35 

A 

-uo 

- 1.13 

- 3.11 

- 3.13 

- 1.17 

- 1.21 


- 1. 10 

- 0.90 

- 0.98 

- 0.99 

- 1.02 

- 1.08 

' J • $ 

- 0.83 

- 0,90 

- 0.85 

- 0.87 

- 0.90 

- 0.95 

.’)* 7" 

- 0.60 

- 0,25 

- 0,75 

-076 


- 0.84 


- 0.60 

- 0,58 

- 0,63 

- 0.65 

- 0.57 

- 0.73 

% 

- 0.60 

- 0.58 

- 0.57 

- 0.56 

- 0 . 5 ? 

- 0.62 

■As 

- 0.60 

- 0.49 

- 0.42 

- 0.46 

- 0.48 

- 0.52 

As 

- 0. 24 

- 0.29 

- 0.40 

-038 

- 0.39 

- 0.42 

2*2 

- 0.21 

- 0.28 

- 0.24 

- 0.29 

-030 

- 0.32 

A3 

- 0.20 

A 70 

- 0.24 

-021 

- 0.21 

- 0.23 

A* 

- 0,20 

- 0,09 

- 0,09 

- 0,12 

- 0 , 1 3 

- 0.14 

As 

- 0.16 

- 0,00 

- 0,07 

- 0.04 

- 0.94 

- 0.05 

As 

0,16 

0,00 

007 

0.04 

0.04 

0.05 

At 

0,10 

0,09 

0.09 

0.12 

0.13 

0.14 

A* 

0.21 

0.28 

0.24 

021 

0 . 2.1 

0.23 

As 

0.22 

0,28 

0.24 

0.29 

0.80 

0.32 


0,23 

0.28 

043 

0.38 

0.39 

0.42 

As 

0.60 

0,49 

0.42 

0.46 

0.48 

0.52 

228 

0.60 

0.58 

0.57 

0.56 

0 . 5 ? 

0.62 

.:X'>3 

0,60 

0.58 

0.62 

0.65 

0,57 

0.73 

-*•24. 

0.60 

0,75 

0.75 

0.76 

0.78 

0.84 

%r> 

0.83 

0.90 

0.85 

0.87 

0.90 

0.95 


3.10 

0.90 

0.98 

0.99 

1 .02 

1.08 

#27 

UO 

1.13 

1,11 

1.13 

1 1 ‘*7 

1.21 

As 

3.10 

1,23 

1 27 

329 

1 33 

1 .35 

Ax 

3.58 

1,46 

1.46 

3.49 

1,53 

1 .50 


1.58 

1.73 

3.74 

1.74 

1 '77 

1.66 

As 

v 

2.19 

2.14 

2.07 

1 

1.85 


r § a t ^ 

rlo. 17a 


U.S. Patent 


Sep. 23, 2014 Sheet 34 of 44 


PAM-32 constellations optimized for parallel decoding capacity at 


(bps) 

2.0 


1 3 '° 

3.5 

4.0 

4.5 

(SENR) 

12.21 

15.2? 

| 18.42 

21.52 

24.79 

28.20 


*2,25 

-2.16 

-2.14 

-2.05 

-1.97 

-1,85 

X: 

-1.52 

-1.64 

*L75 

-1.74 

-1.72 

-1.66 

SSfc 

2.30 

2.19 

-1.31 

2.05 

1.97 

-1,35 

£3 

-1.39 

-1.48 

-1.43 

-1.49 

-1.51 

-1.49 


1.56 

1.54 

2.14 

-0.96 

*103 

1 .85 

Xr> 

-LSI 

-1.23 

1,75 

-1.15 

-1.17 

1,66 

2V> 

1,67 

1.65 

-1,0” 

-0.91 

-0.90 

-1.21 


-.1,31 

-1.24 

-1,04 

-1.28 

-1.33 

-LOS 

■t's 

-0.48 

-0.43 

-0.86 

-0.17 

-0 17 

-0,42 


f. 

f I 

-0.76 

-0.26 

-0.34 

-0.31 

-0.52 

Xw 

-0,48 

-0.45 

-0.62 

-0.1" 

-0.15 

-0.73 


-0.73 

-0,76 

-0.62 

-0.34 

-0.35 

-0.62 

®13 

-0,48 

-0.42 

-0.29 

-0.71 

-0.67 

-0,33 


-0.76 

-0.86 

-0.29 

-0.32 

-0,55 

-0,23 

*14 

-0.48 

-0.42 

-0.77 


*0.77 

-0.84 

*18 

-0,76 

-0,86 

-0.77 

~QS2 

-0.48 

-0.96 


0.87 

0 9$ 

LOT 

1.49 

1.51 

1.21 

. .-v 

0,66 

0.63 

1.04 

1.28 

133 

LOS 

;£'x$i 

0.87 

0.98 

0.77 

174 

1 72 

0.84 


0.66 

0.63 

0.7? 

1.15 

i 17 

0.96 


1.07 

1.13 

1.31 

A ■7 T [ 

0.77 

1,35 


0,66 

0.59 

1.43 

0.91 

0.90 

1,49 


1,05 

1.10 

0.62 

0.71 

0.67 

0.73 

#2a 

0,66 

0.60 

0,62 

0.96 

1.03 

0.62 


-0.01 

-0.08 

0.02 

0.00 

0.01 

0.05 

fit. 

0, 17 

0.25 

0.02 

0.17 

0.15 

0.14 


-0,01 

-0.08 

0.29 

0.00 

-0.01 

0.33 

1'27 

0.17 

0.25 

0.29 

0.17 

0.17 

0.23 


-0.01 

-0.08 

-0,02 

0, 52 

0.48 

-0,05 


0,17 

0.25 

-0.O2 

0.34 

0,35 

-0.14 


-0,01 

-0.08 

0.36 

0.52 

0.55 

0.42 

•?*at 

0,17 

0.25 

0.36 

0.34 

0.3 1 

0.52 


FIG. 17b 


US 8,842,761 B2 


different 


PSK-4 PSK-8 PSK-18 PSK-32 


U.S. Patent 


Sep. 23, 2014 


Sheet 35 of 44 


US 8,842,761 B2 


m <£? 
tz £ 
o ,S 

j§ Jg 

£ ^ 

to ^ 

jTT !v~. 

o 

o O 

to 

Q_ 

T3 03 
<i> C 

,N| Q 

.£ ^5 
”cL f 3 
O h“ 


(ft 

3 


~ — 1 



o 

lo 


00 

CM 


in 

CD 


cxi 

CO 


V 

V 


O 

O 

O 

Q 

Q 

D 

CL 

CL 

CL 

V 

V 

V 

IP 

co 

CO 



> 

X2 

_o 

Jo 

I 

00 

00 

CO 

cx 

uo 

CD 

-r™ 

ex 

CO 


<b 

<Si 

CO 

^ — 

00 


l: 

LC 

CO 

CO 

if) 

CL 

CL 

CL 


...X,, 


-! CO IS 


o: 




350 


U.S. Patent 


Sep. 23, 2014 


Sheet 36 of 44 


US 8,842,761 B2 



S09j6ap ui uoijeooj siuiod 


ST" i /"'» <4 

FIG, 1 9 








QAM-64 constructed from 2 orthogonal PAM-3 optimized fa PDOI .5 bitafdimension 


U.S. Patent 


Sep. 23, 2014 


Sheet 38 of 44 


US 8,842,761 B2 



« V 1 -! 


Fin 91 



PAM4 spfe&ftei for parage! deesfog capacity avac tea isijmg timam 



S 8,842,761 B2 





patsM decra&ng capacity ©vsr She fsdsrtg channe 


U.S. Patent 


Sep. 23, 2014 


Sheet 41 of 44 


US 8,842,761 B2 




PAMS opfessed for parallel decoding capacity o^erthe fading chamal 




PAM1S opfeisod for j^araW decoding capacity ow 8«r isdifig chsnrw 





PAM K! optimized for paratteF decoding capacity ©vet the Fading channel 



US 8,842,761 B2 


1 

METHODOLOGY AND METHOD AND 
APPARATUS FOR SIGNALING WITH 
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STATEMENT OF FEDERALLY SPONSORED 
RESEARCH 

This invention was made with Government support under 
contract NAS7-03001 awarded by NASA. The Government 20 
has certain rights in this invention. 

BACKGROUND 

The present invention generally relates to bandwidth and/ 25 
or power efficient digital transmission systems and more spe- 
cifically to the use of unequally spaced constellations having 
increased capacity. 

The term “constellation” is used to describe the possible 
symbols that can be transmitted by a typical digital commu- 30 
nication system. A receiver attempts to detect the symbols 
that were transmitted by mapping a received signal to the 
constellation. The minimum distance (d mi>; ) between constel- 
lation points is indicative of the capacity of a constellation at 
high signal-to-noise ratios (SNRs). Therefore, constellations 35 
used in many communication systems are designed to maxi- 
mize A mi „. Increasing the dimensionality of a constellation 
allows larger minimum distance for constant constellation 
energy per dimension. Therefore, a number of multi-dimen- 
sional constellations with good minimum distance properties 40 
have been designed. 

Communication systems have a theoretical maximum 
capacity, which is known as the Shannon limit. Many com- 
munication systems attempt to use codes to increase the 
capacity of a communication channel. Significant coding 45 
gains have been achieved using coding techniques such as 
turbo codes and LDPC codes. The coding gains achievable 
using any coding technique are limited by the constellation of 
the communication system. The Shannon limit can be thought 
of as being based upon a theoretical constellation known as a 50 
Gaussian distribution, which is an infinite constellation where 
symbols at the center of the constellation are transmitted 
more frequently than symbols at the edge of the constellation. 
Practical constellations are finite and transmit symbols with 
equal likelihoods, and therefore have capacities that are less 55 
than the Gaussian capacity. The capacity of a constellation is 
thought to represent a limit on the gains that can be achieved 
using coding when using that constellation. 

Prior attempts have been made to develop unequally 
spaced constellations. For example, a system has been pro- 60 
posed that uses unequally spaced constellations that are opti- 
mized to minimize the error rate of an uncoded system. 
Another proposed system uses a constellation with equiprob- 
able but unequally spaced symbols in an attempts to mimic a 
Gaussian distribution. 65 

Other approaches increases the dimensionality of a con- 
stellation or select a new symbol to be transmitted taking into 
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consideration previously transmitted symbols. However, 
these constellation were still designed based on a minimum 
distance criteria. 

SUMMARY OF THE INVENTION 

Systems and methods are described for constructing a 
modulation such that the constrained capacity between a 
transmitter and a receiver approaches the Gaussian channel 
capacity limit first described by Shannon [ref Shannon 1948]. 
Traditional communications systems employ modulations 
that leave a significant gap to Shannon Gaussian capacity. The 
modulations of the present invention reduce, and in some 
cases, nearly eliminate this gap. The invention does not 
require specially designed coding mechanisms that tend to 
transmit some points of a modulation more frequently than 
others but rather provides a method for locating points (in a 
one or multiple dimensional space) in order to maximize 
capacity between the input and output of a bit or symbol 
mapper and demapper respectively. Practical application of 
the method allows systems to transmit data at a given rate for 
less power or to transmit data at a higher rate for the same 
amount of power. 

One embodiment of the invention includes a transmitter 
configured to transmit signals to a receiver via a communica- 
tion channel, wherein the transmitter, includes a coder con- 
figured to receive user bits and output encoded bits at an 
expanded output encoded bit rate, a mapper configured to 
map encoded bits to symbols in a symbol constellation, a 
modulator configured to generate a signal for transmission 
via the communication channel using symbols generated by 
the mapper. In addition, the receiver includes a demodulator 
configured to demodulate the received signal via the commu- 
nication channel, a demapper configured to estimate likeli- 
hoods from the demodulated signal, a decoder that is config- 
ured to estimate decoded bits from the likelihoods generated 
by the demapper. Furthermore, the symbol constellation is a 
capacity optimized geometrically spaced symbol constella- 
tion that provides a given capacity at a reduced signal-to- 
noise ratio compared to a signal constellation that maximizes 

A further embodiment of the invention includes encoding 
the bits of user information using a coding scheme, mapping 
the encoded bits of user information to a symbol constella- 
tion, wherein the symbol constellation is a capacity optimized 
geometrically spaced symbol constellation that provides a 
given capacity at a reduced signal-to-noise ratio compared to 
a signal constellation that maximizes d min , modulating the 
symbols in accordance with a modulation scheme, transmit- 
ting the modulated signal via the communication channel, 
receiving a modulated signal, demodulating the modulated 
signal in accordance with the modulation scheme, demapping 
the demodulated signal using the geometrically shaped signal 
constellation to produce likelihoods, and decoding the likeli- 
hoods to obtain an estimate of the decoded bits. 

.Another embodiment of the invention includes selecting an 
appropriate constellation size and a desired capacity per 
dimension, estimating an initial SNR at which the system is 
likely to operate, and iteratively optimizing the location of the 
points of the constellation to maximize a capacity measure 
until a predetermined improvement in the SNR performance 
of the constellation relative to a constellation that maximizes 
d mjrl has been achieved. 

A still further embodiment of the invention includes select- 
ing an appropriate constellation size and a desired capacity 
per dimension, estimating an initial SNR at which the system 
is likely to operate, and iteratively optimizing the location of 
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the points of the constellation to maximize a capacity mea- 
sure until a predetermined improvement in the SNR perfor- 
mance of the constellation relative to a constellation that 
maximizes d min has been achieved. 

Still another embodiment of the invention includes select- 
ing an appropriate constellation size and a desired SNR, and 
optimizing the location of the points of the constellation to 
maximize a capacity measure of the constellation. 

A yet further embodiment of the invention includes obtain- 
ing a geometrically shaped PAM constellation with a constel- 
lation size that is the square root of said given constellation 
size, where the geometrically shaped PAM constellation has 
a capacity greater than that of a PAM constellation that maxi- 
mizes d mjn , creating an orthogonalized PAM constellation 
using the geometrically shaped PAM constellation, and com- 
bining the geometrically shaped PAM constellation and the 
orthogonalized PAM constellation to produce a geometri- 
cally shaped QAM constellation. 

Another further embodiment of the invention includes 
transmitting information over a channel using a geometri- 
cally shaped symbol constellation, and modifying the loca- 
tion of points within the geometrically shaped symbol con- 
stellation to change the target user data rate. 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a conceptual illustration of a communication 
system in accordance with an embodiment of the invention. 

FIG. 2 is a conceptual illustration of a transmitter in accor- 
dance with an embodiment of the invention. 

FIG. 3 is a conceptual illustration of a receiver in accor- 
dance with an embodiment of the invention. 

FIG. 4 a is a conceptual illustration of the joint capacity of 
a channel. 

FIG. 4b is a conceptual illustration of the parallel decoding 
capacity of a channel. 

FIG. 5 is a flow chart showing a process for obtaining a 
constellation optimized for capacity for use in a communica- 
tion system having a fixed code rate and modulation scheme 
in accordance with an embodiment of the invention. 

FIG. 6 a is a chart showing a comparison of Gaussian 
capacity and PD capacity for traditional PAM-2,4,8,16,32. 

FIG. 6b is a chart showing a comparison between Gaussian 
capacity and joint capacity for traditional PAM-2,4,8,16,32. 

FIG. 7 is a chart showing the SNR gap to Gaussian capacity 
for the PD capacity and joint capacity of traditional PAM-2, 
4,8,16,32 constellations. 

FIG. 8a is a chart comparing the SNR gap to Gaussian 
capacity of the PD capacity for traditional and optimized 
PAM-2,4,8,16,32 constellations. 

FIG. 8 b is a chart comparing the SNR gap to Gaussian 
capacity of the joint capacity for traditional and optimized 
PAM-2,4,8,16,32 constellations. 

FIG. 9 is a chart showing Frame Error Rate performance of 
traditional and PD capacity optimized PAM-32 constellations 
in simulations involving several different length LDPC 
codes. 

FIGS. 10a-10<7 are locus plots showing the location of 
constellation points of a PAM-4 constellation optimized for 
PD capacity and j oint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 11a and 11 b are design tables of PD capacity and 
joint capacity optimized PAM-4 constellations in accordance 
with embodiments of the invention. 
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FIGS. 12a-12d are locus plots showing the location of 
constellation points of a PAM-8 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

5 FIGS. 13a and 13 b are design tables of PD capacity and 
joint capacity optimized PAM-8 constellations in accordance 
with embodiments of the invention. 

FIGS. 14a-14<7 are locus plots showing the location of 
constellation points of a PAM-1 6 constellation optimized for 
to PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 15a and ISA are design tables of PD capacity and 
joint capacity optimized PAM- 16 constellations in accor- 
dance with embodiments of the invention. 

15 FIGS. 16a-16<7 are locus plots showing the location of 
constellation points of a PAM-32 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 17a and lib are design tables of PD capacity and 
20 joint capacity optimized PAM-32 constellations in accor- 
dance with embodiments of the invention. 

FIG. 18 is a chart showing the SNR gap to Gaussian capac- 
ity for traditional and capacity optimized PSK constellations. 

FIG. 19 is a chart showing the location of constellation 
25 points of PD capacity optimized PSK-32 constellations. 

FIG. 20 is a series of PSK-32 constellations optimized for 
PD capacity at different SNRs in accordance with embodi- 
ments of the invention. 

FIG. 21 illustrates a QAM-64 constructed from orthogonal 
30 Cartesian product of two PD optimized PAM-8 constellations 
in accordance with an embodiment of the invention. 

FIGS. 22a and 22 b are locus plots showing the location of 
constellation points of a PAM -4 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
35 dimension and versus SNR. 

FIGS. 23a and 23 b are locus plots showing the location of 
constellation points of a PAM-8 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
dimension and versus SNR. 

40 FIGS. 24a and 24 b are locus plots showing the location of 
constellation points of a PAM- 16 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
dimension and versus SNR. 

45 DETAILED DESCRIPTION OF THE INVENTION 

Turning now to the drawings, communication systems in 
accordance with embodiments of the invention are described 
that use signal constellations, which have unequally spaced 
50 (i.e. ‘geometrically’ shaped) points. In several embodiments, 
the locations of geometrically shaped points are designed to 
provide a given capacity measure at a reduced signal-to-noise 
ratio (SNR) compared to the SNR required by a constellation 
that maximizes d mjn . In many embodiments, the constella- 
55 tions are selected to provide increased capacity at a predeter- 
mined range of channel signal-to-noise ratios (SNR). Capac- 
ity measures that can be used in the selection of the location 
of constellation points include, but are not limited to, parallel 
decode (PD) capacity and joint capacity. 

60 In many embodiments, the co mmu nication systems utilize 
capacity approaching codes including, but not limited to, 
LDPC and Turbo codes. As is discussed further below, direct 
optimization of the constellation points of a co mm unication 
system utilizing a capacity approaching channel code, can 
65 yield different constellations depending on the SNR for 
which they are optimized. Therefore, the same constellation 
is unlikely to achieve the same coding gains applied across all 
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code rates; that is, the same constellation will not enable the 
best possible performance across all rates. In many instances, 
a constellation at one code rate can achieve gains that cannot 
be achieved at another code rate. Processes for selecting 
capacity optimized constellations to achieve increased cod- 
ing gains based upon a specific coding rate in accordance with 
embodiments of the invention are described below. In a num- 
ber of embodiments, the communication systems can adapt 
location of points in a constellation in response to channel 
conditions, changes in code rate and/or to change the target 
user data rate. 

Communication Systems 

A communication system in accordance with an embodi- 
ment of the invention is shown in FIG. 1 . The communication 
system 10 includes a source 12 that provides user bits to a 
transmitter 14. The transmitter transmits symbols over a 
channel to a receiver 16 using a predetermined modulation 
scheme. The receiver uses knowledge of the modulation 
scheme, to decode the signal received from the transmitter. 
The decoded bits are provided to a sink device that is con- 
nected to the receiver. 

A transmitter in accordance with an embodiment of the 
invention is shown in FIG. 2. The transmitter 14 includes a 
coder 20 that receives user bits from a source and encodes the 
bits in accordance with a predetermined coding scheme. In a 
number of embodiments, a capacity approaching code such as 
a turbo code or a LDPC code is used. In other embodiments, 
other coding schemes can be used to providing a coding gain 
within the communication system. A mapper 22 is connected 
to the coder. The mapper maps the bits output by the coder to 
a symbol within a geometrically distributed signal constella- 
tion stored within the mapper. The mapper provides the sym- 
bols to a modulator 24, which modulates the symbols for 
transmission via the channel. 

A receiver in accordance with an embodiment of the inven- 
tion is illustrated in FIG. 3. The receiver 16 includes a 
demodulator 30 that demodulates a signal received via the 
channel to obtain symbol or bit likelihoods. The demapper 
uses knowledge of the geometrically shaped symbol constel- 
lation used by the transmitter to determine these likelihoods. 
The demapper 3 2 provides the likelihoods to a decoder 34 that 
decodes the encoded bit stream to provide a sequence of 
received bits to a sink. 

Geometrically Shaped Constellations 

Transmitters and receivers in accordance with embodi- 
ments of the invention utilize geometrically shaped symbol 
constellations. In several embodiments, a geometrically 
shaped symbol constellation is used that optimizes the capac- 
ity of the constellation. Various geometrically shaped symbol 
constellations that can be used in accordance with embodi- 
ments of the invention, techniques for deriving geometrically 
shaped symbol constellations are described below. 

Selection of a Geometrically Shaped Constellation 

Selection of a geometrically shaped constellation for use in 
a communication system in accordance with an embodiment 
of the invention can depend upon a variety of factors includ- 
ing whether the code rate is fixed. In many embodiments, a 
geometrically shaped constellation is used to replace a con- 
ventional constellation (i.e. a constellation maximized for 
d ml „) in the mapper of transmitters and the demapper of 
receivers within a communication system. Upgrading a com- 
munication system involves selection of a constellation and in 
many instances the upgrade can be achieved via a simple 
firmware upgrade. In other embodiments, a geometrically 
shaped constellation is selected in conjunction with a code 
rate to meet specific performance requirements, which can for 
example include such factors as a specified bit rate, a maxi- 
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mum transmit power. Processes for selecting a geometric 
constellation when upgrading existing communication sys- 
tems and when designing new communication systems are 
discussed further below. 

5 Upgrading Existing Communication Systems 

A geometrically shaped constellation that provides a 
capacity, which is greater than the capacity of a constellation 
maximized for d m „„ can be used in place of a conventional 
constellation in a communication system in accordance with 
to embodiments of the invention. In many instances, the substi- 
tution of the geometrically shaped constellation can be 
achieved by a firmware or software upgrade of the transmit- 
ters and receivers within the communication system. Not all 
geometrically shaped constellations have greater capacity 
15 than that of a constellation maximized for d„„„. One approach 
to selecting a geometrically shaped constellation having a 
greater capacity than that of a constellation maximized for 
d„,„, is to optimize the shape of the constellation with respect 
to a measure of the capacity of the constellation for a given 
20 SNR. Capacity measures that can be used in the optimization 
process can include, but are not limited to, joint capacity or 
parallel decoding capacity. 

Joint Capacity and Parallel Decoding Capacity 

A constellation can be parameterized by the total number 
25 of constellation points, M, and the number of real dimensions, 
N a>! . In systems where there are no belief propagation itera- 
tions between the decoder and the constellation demapper, 
the constellation demapper can be thought of as part of the 
channel. A diagram conceptually illustrating the portions of a 
30 communication system that can be considered part of the 
channel for the purpose of determining PD capacity is shown 
in FIG . 4a. The portions of the communication system that are 
considered part of the channel are indicated by the ghost line 
40. The capacity of the channel defined as such is the parallel 
35 decoding (PD) capacity, given by: 


t'-l 

c PD = ^ /(*,-; Y) 


where X, is the ith bit of the I-bits transmitted symbol, and Y 
is the received symbol, and I(A;B) denotes the mutual infor- 
mation between random variables A and B. 

45 Expressed another way, the PD capacity of a channel can be 

viewed in terms of the mutual information between the output 
bits of the encoder (such as an LDPC encoder) at the trans- 
mitter and the likelihoods computed by the demapper at the 
receiver. The PD capacity is influenced by both the placement 
50 of points within the constellation and by the labeling assign- 
ments. 

With belief propagation iterations between the demapper 
and the decoder, the demapper can no longer be viewed as part 
of the channel, and the joint capacity of the constellation 
55 becomes the tightest known bound on the system perfor- 
mance. A diagram conceptually illustrating the portions of a 
communication system that are considered part of the channel 
for the purpose of determining the joint capacity of a constel- 
lation is shown in FIG. 4b. The portions of the communica- 
60 tion system that are considered part of the channel are indi- 
cated by the ghost line 42. The joint capacity of the channel is 
given by: 

( join ! Y{X; Y) 

65 Joint capacity is a description of the achievable capacity 
between the input of the mapper on the transmit side of the 
link and the output of the channel (including for example 
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AWGN and Fading channels). Practical systems must often 
‘demap’ channel observations prior to decoding. In general, 
the step causes some loss of capacity. In fact it can be proven 
that C G >C jo1N i^C pd . That is, C JOINT upper bounds the 
capacity achievable by C PD . The methods of the present 5 
invention are motivated by considering the fact that practical 
limits to a given co mm unication system capacity are limited 
by C J01NT and C PD . In several embodiments of the invention, 
geometrically shaped constellations are selected that maxi- 
mize these measures. to 

Selecting a Constellation Having an Optimal Capacity 

Geometrically shaped constellations in accordance with 
embodiments of the invention can be designed to optimize 
capacity measures including, but not limited to PD capacity 
or joint capacity. A process for selecting the points, and poten- 15 
tially the labeling, of a geometrically shaped constellation for 
use in a communication system having a fixed code rate in 
accordance with an embodiment of the invention is shown in 
FIG. 5. The process 50 commences with the selection (52) of 
an appropriate constellation size M and a desired capacity per 20 
dimension r). In the illustrated embodiment, the process 
involves a check (52) to ensure that the constellation size can 
support the desired capacity. In the event that the constellation 
size could support the desired capacity, then the process itera- 
tively optimizes the M-ary constellation for the specified 25 
capacity. Optimizing a constellation for a specified capacity 
often involves an iterative process, because the optimal con- 
stellation depends upon the SNR at which the communication 
system operates. The SNR for the optimal constellation to 
give a required capacity is not known a priori. Throughout the 30 
description of the present invention SNR is defined as the 
ratio of the average constellation energy per dimension to the 
average noise energy per dimension. In most cases the capac- 
ity can be set to equal the target user bit rate per symbol per 
dimension. In some cases adding some implementation mar- 35 
gin on top of the target user bit rate could result in a practical 
system that can provide the required user rate at a lower rate. 
The margin is code dependent. The following procedure 
could be used to determine the target capacity that includes 
some margin on top of the user rate. F irst, the code (e.g. LDPC 40 
or Turbo) can be simulated in conjunction with a conventional 
equally spaced constellation. Second, from the simulation 
results the actual SNR of operation at the required error rate 
can be found. Third, the capacity of the conventional constel- 
lation at that SNR can be computed. Finally, a geometrically 45 
shaped constellation can be optimized for that capacity. 

In the illustrated embodiment, the iterative optimization 
loop involves selecting an initial estimate of the SNR at which 
the system is likely to operate (i.e. SNR ;>i ). In several embodi- 
ments the initial estimate is the SNR required using a con- 50 
ventional constellation. In other embodiments, other tech- 
niques can be used for selecting the initial SNR. An M-ary 
constellation is then obtained by optimizing (56) the constel- 
lation to maximize a selected capacity measure at the initial 
SNR i;i estimate. Various techniques for obtaining an opti- 55 
mized constellation for a given SNR estimate are discussed 
below. 

The SNR at which the optimized M-ary constellation pro- 
vides the desired capacity per dimension r| (SNR 0 „,) is deter- 
mined (57). A determination (58) is made as to whether the 60 
SNR our and SNR I>; have converged. In the illustrated embodi- 
ment convergence is indicated by SNR oi , r equaling SNR !H . In 
a number of embodiments, convergence can be determined 
based upon the difference between SNR our and SNR,„ being 
less than a predetermined threshold. When SNR oi(r and SNR i>( 65 
have not converged, the process performs another iteration 
selecting SNR 0 „, as the new SNR,„ (55). When SNR our and 
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SNR„, have converged, the capacity measure of the constel- 
lation has been optimized. As is explained in more detail 
below, capacity optimized constellation at low SNRs are geo- 
metrically shaped constellations that can achieve signifi- 
cantly higher performance gains (measured as reduction in 
minimum required SNR) than constellations that maximize 

The process illustrated in FIG. 5 can maximize PD capacity 
or joint capacity of an M-ary constellation for a given SNR. 
Although the process illustrated in FIG. 5 shows selecting an 
M-ary constellation optimized for capacity, a similar process 
could be used that terminates upon generation of an M-ary 
constellation where the SNR gap to Gaussian capacity at a 
given capacity is a predetermined margin lower than the SNR 
gap of a conventional constellation, for example 0.5 db. Alter- 
natively, other processes that identify M-ary constellations 
having capacity greater than the capacity of a conventional 
constellation can be used in accordance with embodiments of 
the invention. A geometrically shaped constellation in accor- 
dance with embodiments of the invention can achieve greater 
capacity than the capacity of a constellation that maximizes 
d m „, without having the optimal capacity for the SNR range 
within which the communication system operates. 

We note that constellations designed to maximize joint 
capacity may also be particularly well suited to codes with 
symbols over GF(q), or with multi-stage decoding. Con- 
versely constellations optimized for PD capacity could be 
better suited to the more common case of codes with symbols 
over GF(2) 

Optimizing the Capacity of an M-Ary Constellation at a 
Given SNR 

Processes for obtaining a capacity optimized constellation 
often involve determining the optimum location for the points 
of an M-ary constellation at a given SNR. An optimization 
process, such as the optimization process 56 shown in FIG. 5, 
typically involves unconstrained or constrained non-linear 
optimization. Possible objective functions to be maximized 
are the Joint or PD capacity functions. These functions may 
be targeted to channels including but not limited to Additive 
White Gaussian Noi se (AWGN) or Rayleigh fading channels . 
The optimization process gives the location of each constel- 
lation point identified by its symbol labeling. In the case 
where the objective is joint capacity, point bit labelings are 
irrelevant meaning that changing the bit labelings doesn’t 
change the joint capacity as long as the set of point locations 
remains unchanged. 

The optimization process typically finds the constellation 
that gives the largest PD capacity or joint capacity at a given 
SNR. The optimization process itself often involves an itera- 
tive numerical process that among other things considers 
several constellations and selects the constellation that gives 
the highest capacity at a given SNR. In other embodiments, 
the constellation that requires the least SNR to give a required 
PD capacity or joint capacity can also be found. This requires 
running the optimization process iteratively as shown in FIG. 
5. 

Optimization constraints on the constellation point loca- 
tions may include, but are not limited to, lower and upper 
bounds on point location, peak to average power of the result- 
ing constellation, and zero mean in the resulting constella- 
tion. It can be easily shown that a globally optimal constella- 
tion will have zero mean (no DC component). Explicit 
inclusion of a zero mean constraint helps the optimization 
routine to converge more rapidly. Except for cases where 
exhaustive search of all combinations of point locations and 
labelings is possible it will not necessarily always be the case 
that solutions are provably globally optimal. In cases where 
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exhaustive search is possible, the solution provided by the 
non-linear optimizer is in fact globally optimal. 

The processes described above provide examples of the 
manner in which a geometrically shaped constellation having 
an increased capacity relative to a conventional capacity can 5 
be obtained for use in a co mmu nication system having a fixed 
code rate and modulation scheme. The actual gains achiev- 
able using constellations that are optimized for capacity com- 
pared to conventional constellations that maximize d mf „ are 
considered below. to 

Gains Achieved by Optimized Geometrically Spaced Con- 
stellations 

The ultimate theoretical capacity achievable by any com- 
munication method is thought to be the Gaussian capacity, C G 
which is defined as: 15 


C c = ilo fe (l + SNR) 

20 

Where signal -to-noise (SNR) is the ratio of expected signal 
power to expected noise power. The gap that remains between 
the capacity of a constellation and C G can be considered a 
measure of the quality of a given constellation design. 

The gap in capacity between a conventional modulation 25 
scheme in combination with a theoretically optimal coder can 
be observed with reference to FIGS. 6 a and 6b. FIG. 6a 
includes a chart 60 showing a comparison between Gaussian 
capacity and the PD capacity of conventional PAM-2, 4, 8, 16, 
and 32 constellations that maximize d m „„ Gaps 62 exist 3< 1 
between the plot of Gaussian capacity and the PD capacity of 
the various PAM constellations. FIG. 6b includes a chart 64 
showing a comparison between Gaussian capacity and the 
joint capacity of conventional PAM-2, 4, 8, 16, and 32 con- 
stellations that maximize d ml „, Gaps 66 exist between the plot 
of Gaussian capacity and the joint capacity of the various 
PAM constellations. These gaps in capacity represent the 
extent to which conventional PAM constellations fall short of 
obtaining the ultimate theoretical capacity i.e. the Gaussian 
capacity. 40 

In order to gain a better view of the differences between the 
curves shown in FIGS. 6 a and 6b at points close to the Gaus- 
sian capacity, the SNR gap to Gaussian capacity for different 
values of capacity for each constellation are plotted in FIG. 7. 

It is interesting to note from the chart 70 in FIG. 7 that (unlike 45 
the joint capacity) at the same SNR, the PD capacity does not 
necessarily increase with the number of constellation points. 

As is discussed further below, this is not the case with PAM 
constellations optimized for PD capacity. 

FIGS. 8a and 8b summarize performance of constellations 50 
for PAM-4, 8, 1 6, and 32 optimized for PD capacity and joint 
capacity (it should be noted that BPSK is the optimal PAM-2 
constellation at all code rates). Hie constellations are opti- 
mized for PD capacity and joint capacity for different target 
user bits per dimension (i.e. code rates). The optimized con- - 5 
stellations are different depending on the target user bits per 
dimension, and also depending on whether they have been 
designed to maximize the PD capacity or the joint capacity. 

All the PD optimized PAM constellations are labeled using a 
gray labeling which is not always the binary reflective gray 
labeling. It should be noted that not all gray labels achieve the 60 
maximum possible PD capacity even given the freedom to 
place the constellation points anywhere on the real line. FIG. 

8a shows the SNR gap for each constellation optimized for 
PD capacity. FIG. 8b shows the SNR gap to Gaussian capac- 
ity for each constellation optimized for joint capacity. Again, 65 
it should be emphasized that each ‘+’011 the plot represents a 
different constellation. 
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Referring to FIG. 8a, the coding gain achieved using a 
constellation optimized for PD capacity can be appreciated 
by comparing the SNR gap at a user bit rate per dimension of 

2.5 bits for PAM-32. A user bit rate per dimension of 2.5 bits 
for a system transmitting 5 bits per symbol constitutes a code 
rate of Vi. At that code rate the constellation optimized for PD 
capacity provides an additional coding gain of approximately 

1 .5 dB when compared to the conventional PAM-32 constel- 
lation. 

The SNR gains that can be achieved using constellations 
that are optimized for PD capacity can be verified through 
simulation. The results of a simulation conducted using a rate 
1/2 LDPC code in conjunction with a conventional PAM-32 
constellation and in conjunction with a PAM-32 constellation 
optimized for PD capacity are illustrated in FIG. 9 . A chart 90 
includes plots of Frame Error Rate performance of the differ- 
ent constellations with respect to SNR and using different 
length codes (i.e. k=4,096 and k=l 6,384). Irrespective of the 
code that is used, the constellation optimized for PD capacity 
achieves a gain of approximately 1.3 dB, which closely 
approaches the gain predicted from FIG. 8a. 

Capacity Optimized Pam Constellations 

Using the processes outlined above, locus plots of PAM 
constellations optimized for capacity can be generated that 
show the location of points within PAM constellations versus 
SNR. Locus plots of PAM-4, 8, 16, and 32 constellations 
optimized for PD capacity and joint capacity and correspond- 
ing design tables at various typical user bit rates per dimen- 
sion are illustrated in FIGS. 10a-176. The locus plots and 
design tables show PAM-4,8,16,32 constellation point loca- 
tions and labelings from low to high SNR corresponding to a 
range of low to high spectral efficiency. 

In FIG. 10a, a locus plot 100 shows the location of the 
points of PAM-4 constellations optimized for Joint capacity 
plotted against achieved capacity. A similar locus plot 105 
showing the location of the points of Joint capacity optimized 
PAM -4 constellations plotted against SNR is included in FIG. 
10 b. In FIG. 10c. the location of points for PAM-4 optimized 
for PD capacity is plotted against achievable capacity and in 
FIG. 10 d the location of points for PAM-4 for PD capacity is 
plotted against SNR. At low SNRs, the PD capacity optimized 
PAM-4 constellations have only 2 unique points, while the 
Joint optimized constellations have 3. As SNR is increased, 
each optimization eventually provides 4 unique points. This 
phenomenon is explicitly described in FIG. 11a and FIG. 11 b 
where vertical slices of FIGS. 10 ab and 10 cd are captured in 
tables describing some PAM-4 constellations designs of 
interest. The SNR slices selected represent designs that 
achieve capacities={0. 5, 0.75, 1.0, 1.25, 1.5} bits per symbol 
(bps). Given that PAM-4 can provide at most log 2 (4)=2 bps, 
these design points represent systems with information code 
rates R={!4, Ys, Vi, Ys, %} respectively. 

FIGS. 12 ab and 12cd present locus plots of PD capacity 
and joint capacity optimized PAM-8 constellation points ver- 
sus achievable capacity and SNR. FIGS. 13a and 13 b provide 
slices from these plots at SNRs corresponding to achievable 
capacities r|={0. 5, 1.0, 1.5, 2.0, 2.5} bps. Each of these slices 
correspond to systems with code rate R=r| bps/log 2 (8), result- 
ing in R={V6, Vs, V 2 , Vs, %}. As an example of the relative 
performance of the constellations in these tables, consider 
FIG. 13 b which shows a PD capacity optimized PAM-8 con- 
stellation optimized for SNR=9.00 dB, or 1.5 bps. We next 
examine the plot provided in FIG. 8a and see that the gap of 
the optimized constellation to the ultimate, Gaussian, capac- 
ity (CG) is approximately 0.5 dB. At the same spectral effi- 
ciency, the gap of the traditional PAM-8 constellation is 
approximately 1 .0 dB. The advantage of the optimized con- 
stellation is 0.5 dB for the same rate (in this case R=!/ 2 ). This 
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gain can be obtained by only changing the mapper and 
demapper in the co mmu nication system and leaving all other 
blocks the same. 

Similar information is presented in FIGS. I4abcd, and 
15 ab which provide loci plots and design tables for PAM- 1 6 
PD capacity and joint capacity optimized constellations. 
Likewise FIGS. 16 abed, llab provide loci plots and design 
tables for PAM-32 PD capacity and joint capacity optimized 
constellations. 

Capacity Optimized PSK Constellations 

Traditional phase shift keyed (PSK) constellations are 
already quite optimal. This can be seen in the chart 180 
comparing the SNR gaps of tradition PSK with capacity 
optimized PSK constellations shown in FIG. 18 where the 
gap between PD capacity and Gaussian capacity is plotted for 
traditional PSK-4,8, 16,32 and for PD capacity optimized 
PSK-4,8,16,32. 

The locus plot of PD optimized PSK-32 points across SNR 
is shown in FIG. 19, which actually characterizes all PSKs 
with spectral efficiency r|<5. This can be seen in FIG. 20 . 
Note that at low SNR (0.4 dB) the optimal PSK-32 design is 
the same as traditional PSK-4, at SNR=8.4 dB optimal PSK- 
32 is the same as traditional PSK-8, at SNR=14.8 dB optimal 
PSK-32 is the same as traditional PSK- 16, and finally at 
SNRs greater than 20.4 dB optimized PSK-32 is the same as 
traditional PSK-32. There are SNRs between these discrete 
points (for instance SNR=2 and 15. dB) for which optimized 
PSK-32 provides superior PD capacity when compared to 
traditional PSK constellations. 

We note now that the locus of points for PD optimized 
PSK-32 in FIG. 19 in conjunction with the gap to Gaussian 
capacity curve for optimized PSK-32 in FIG. 18 implies a 
potential design methodology. Specifically, the designer 
could achieve performance equivalent or better than that 
enabled by traditional PSK-4,8, 16 by using only the opti- 
mized PSK-32 in conjunction with a single tuning parameter 
that controlled where the constellation points should be 
selected from on the locus of FIG. 19 . Such an approach 
would couple a highly rate adaptive channel code that could 
vary its rate, for instance, rate 4/ 5 to achieve and overall (code 
plus optimized PSK-32 modulation) spectral efficiency of 4 
bits per symbol, down to Vs to achieve an overall spectral 
efficiency of 1 bit per symbol. Such an adaptive modulation 
and coding system could essentially perform on the optimal 
continuum represented by the rightmost contour of FIG. 18 . 
Adaptive Rate Design 

In the previous example spectrally adaptive use of PSK-32 
was described. Techniques similar to this can be applied for 
other capacity optimized constellations across the link 
between a transmitter and receiver. For instance, in the case 
where a system implements quality of service it is possible to 
instruct a transmitter to increase or decrease spectral effi- 
ciency on demand. In the context of the current invention a 
capacity optimized constellation designed precisely for the 
target spectral efficiency can be loaded into the transmit map- 
per in conjunction with a code rate selection that meets the 
end user rate goal. When such a modulation/code rate change 
occurred a message could propagated to the receiver so that 
the receiver, in anticipation of the change, could select a 
demapper/decoder configuration in order to match the new 
transmit-side configuration. 

Conversely, the receiver could implement a quality of per- 
formance based optimized constellation/code rate pair con- 
trol mechanism. Such an approach would include some form 
of receiver quality measure. This could be the receiver’s 
estimate of SNR or bit error rate. Take for example the case 
where bit error rate was above some acceptable threshold. In 
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this case, via a backchannel, the receiver could request that 
the transmitter lower the spectral efficiency of the link by 
swapping to an alternate capacity optimized constellation/ 
code rate pair in the coder and mapper modules and then 
5 signaling the receiver to swap in the complementary pairing 
in the demapper/decoder modules. 

Geometrically Shaped QAM Constellations 

Quadrature amplitude modulation (QAM) constellations 
can be constructed by orthogonalizing PAM constellations 
10 into QAM inphase and quadrature components. Constella- 
tions constructed in this way can be attractive in many appli- 
cations because they have low-complexity demappers. 

In FIG. 21 we provide an example of a Quadrature Ampli- 
15 tude Modulation constellation constructed from a Pulse 
Amplitude Modulation constellation. The illustrated embodi- 
ment was constructed using a PAM-8 constellation optimized 
for PD capacity at user bit rate per dimension of 1.5 bits 
(corresponds to an SNR of 9.0 dB) (see FIG. lib). The label- 
point pairs in this PAM-8 constellation are {(000, -1.72), 
(001, -0.81), (010, 1.72), (Oil, -0.62), (100, 0.62), (101, 
0.02), (110, 0.81), (111, -0.02)}. Examination of FIG. 21 
shows that the QAM constellation construction is achieved by 
replicating a complete set of PAM-8 points in the quadrature 
dimension for each of the 8 PAM-8 points in the in-phase 
dimension. Labeling is achieved by assigning the PAM-8 
labels to the LSB range on the in-phase dimension and to the 
MSB range on the quadrature dimension. The resulting 8x8 
outer product forms a highly structured QAM-64 for which 
30 very low-complexity de-mappers can be constructed. Due to 
the orthogonality of the in-phase and quadrature components 
the capacity characteristics of the resulting QAM-64 constel- 
lation are identical to that of the PAM-8 constellation on a 
per-dimension basis. 

35 N-Dimensional Constellation Optimization 

Rather than designing constellations in 1-D (PAM for 
instance) and then extending to 2-D (QAM), it is possible to 
take direct advantage in the optimization step of the addi- 
tional degree of freedom presented by an extra spatial dimen- 
4Q sion. In general it is possible to design N-dimensional con- 
stellations and associated labelings. The complexity of the 
optimization step grows exponentially in the number of 
dimensions as does the complexity of the resulting receiver 
de-mapper. Such constructions constitute embodiments of 
the invention and simply require more ‘run-time’ to produce. 
Capacity Optimized Constellations for Fading Channels 
Similar processes to those outlined above can be used to 
design capacity optimized constellations for fading channels 
in accordance with embodiments of the invention. The pro- 
5Q cesses are essentially the same with the exception that the 
manner in which capacity is calculated is modified to account 
for the fading channel. A fading channel can be described 
using the following equation: 

55 Y=a(t)‘X+N 

where X is the transmitted signal, N is an additive white 
Gaussian noise signal and a(t) is the fading distribution, 
which is a function of time. 

In the case of a fading channel, the instantaneous SNR at 
60 the receiver changes according to a fading distribution. The 
fading distribution is Rayleigh and has the property that the 
average SNR of the system remains the same as in the case of 
the AWGN channel, E[X 2 ]/E[N 2 ]. Therefore, the capacity of 
the fading channel can be computed by taking the expectation 
65 of AWGN capacity, at a given average SNR, over the Ray- 
leigh fading distribution of a that drives the distribution of the 
instantaneous SNR. 
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Many fading channels follow a Rayleigh distribution. 
FIGS. 22a-24b are locus plots of PAM-4, 8, and 16 constel- 
lations that have been optimized for PD capacity on a Ray- 
leigh fading channel. Locus plots versus user bit rate per 
dimension and versus SNR are provided. Similar processes 5 
can be used to obtain capacity optimized constellations that 
are optimized using other capacity measures, such as joint 
capacity, and/or using different modulation schemes. 

What is claimed is: 

1. A digital communication system, comprising: to 

a transmitter configured to transmit signals to a receiver via 

a communication channel; 

wherein the transmitter, comprises: 

a coder configured to receive user bits and output 
encoded bits at an expanded output encoded bit rate 15 
using an LDPC code; 

a mapper configured to map encoded bits to symbols in 
a QAM symbol constellation; 
a modulator configured to generate a signal for transmis- 
sion via the communication channel using symbols 20 
generated by the mapper; and 
wherein the QAM symbol constellation is a geometri- 
cally spaced symbol constellation optimized for 
capacity using parallel decode capacity that provides 
a given capacity at a reduced signal-to-noise ratio 25 
compared to a QAM signal constellation that maxi- 
mizes d min . 

2. The communication system of claim 1, wherein the 

geometrically spaced symbol constellation is capacity opti- 
mized subject to additional constraints. 30 

3. The communication system of claim 1, wherein the 
channel is an AWGN channel. 

4 . The communication system of claim 1 , wherein the 
channel is a fading channel. 

5 . The communication system of claim 1 , wherein the 35 
QAM constellation is a QAM-64 constellation. 

6. The communication system of claim 5, wherein the 
LDPC code is a rate 1/2 LDPC code. 

7. The communication system of claim 6, wherein the 
symbol constellation is formed using a PAM-8 constellation 40 
comprising the set of constellation points {-1.72,-0.81, 1.72, 
-0.62, 0.62, 0.02, 0.81, -0.02}. 

8. The communication system of claim 5, wherein the 
LDPC code is a rate 2/3 LDPC code. 

9. The communication system of claim 8, wherein the 45 
symbol constellation is formed using a PAM-8 constellation 
comprising the set of constellation points {-1.64, -0.97, 1.64, 
-0.58,0.58,0.15,0.97,-0.15}. 

10 . The communication system of claim 5 , wherein the 

LDPC code is a rate 5/6 LDPC code. 50 

11 . The communication system of claim 10 , wherein the 
symbol constellation is formed using a PAM-8 constellation 
comprising the set of constellation points {-1.60, -1.03, 
-0.19, -0.58, 1.60, 1.03, 0.19, 0.58}. 

12 . The communication system of claim 1 , wherein the 55 
QAM constellation is a QAM-256 constellation. 

13 . The communication system of claim 12 , wherein the 
LDPC code is a rate 1/2 LDPC code. 

14 . The co mmu nication system of claim 13 , wherein the 
symbol constellation is formed using a PAM- 1 6 constellation 60 
comprising the set of constellation points {-1.98, -1.29, 1.94, 
-1.17, -0.38, -0.65, -0.38, -0.68, 1.09, 0.76, 1.26, 0.76, 
0.06, 0.29, 0.06, 0.29}. 

15 . The communication system of claim 12 , wherein the 

LDPC code is a rate 3/4 LDPC code. 65 

16 . The communication system of claim 15 , wherein the 
symbol constellation is formed using a PAM- 1 6 constellation 
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comprising the set of constellation points {-1 .84, -1.42, 1.84, 
-1.11, -0.40, -0.65, -0.29, -0.83, 1.11, 0.84, 1.42, 0.65, 
0.05, 0.29, -0.05, 0.40}. 

17 . A digital communication system, comprising: 

a receiver configured to receive signals transmitted via a 
communication channel using a QAM symbol constel- 
lation; 

wherein the receiver, comprises: 

a demodulator configured to demodulate the signal 
received via the communication channel; 
a demapper configured to estimate likelihoods of sym- 
bols in a QAM symbol constellation from the 
demodulated signal; 

a decoder that is configured to estimate decoded bits 
from the likelihoods generated by the demapper using 
an LDPC code; and 

wherein the QAM symbol constellation is a geometri- 
cally spaced symbol constellation optimized for 
capacity using parallel decode capacity that provides 
a given capacity at a reduced signal-to-noise ratio 
compared to a QAM signal constellation that maxi- 
mizes d„„.„. 

18 . The communication system of claim 17 , wherein the 
geometrically spaced symbol constellation is capacity opti- 
mized subject to additional constraints. 

19 . The communication system of claim 17 , wherein the 
channel is an AWGN channel. 

20. The communication system of claim 17, wherein the 
channel is a fading channel. 

21 . The communication system of claim 17 , wherein the 
QAM constellation is a QAM-64 constellation. 

22 . The communication system of claim 21 , wherein the 
LDPC code is a rate 1/2 LDPC code. 

23 . The communication system of claim 22 , wherein the 
symbol constellation is formed using a PAM-8 constellation 
comprising the set of constellation points {-1. 72, -0.81,1. 72, 
-0.62,0.62,0.02,0.81,-0.02}. 

24 . The communication system of claim 21 , wherein the 
LDPC code is a rate 2/3 LDPC code. 

25 . The communication system of claim 24 , wherein the 
symbol constellation is fomied using a PAM-8 constellation 
comprisingthesetofconstellationpoints {-1.64, -0.97, 1.64, 
-0.58, 0.58, 0.15, 0.97,-0.15}. 

26 . The communication system of claim 21 , wherein the 
LDPC code is a rate 5/6 LDPC code. 

27 . The communication system of claim 26 , wherein the 
symbol constellation is formed using a PAM-8 constellation 
comprising the set of constellation points {-1.60, -1.03, 
-0.19, -0.58, 1.60, 1.03, 0.19, 0.58}. 

28 . The communication system of claim 17 , wherein the 
QAM constellation is a QAM-256 constellation. 

29 . The communication system of claim 28 , wherein the 
LDPC code is a rate 1/2 LDPC code. 

30 . The communication system of claim 29 , wherein the 
symbol constellation is formed using a PAM- 1 6 constellation 
comprisingthesetofconstellationpoints {-1.98, -1.29, 1.94, 
-1.17, -0.38, -0.65, -0.38, -0.68, 1.09, 0.76, 1.26, 0.76, 
0.06, 0.29, 0.06, 0.29}. 

31 . The communication system of claim 28 , wherein the 
LDPC code is a rate 3/4 LDPC code. 

32 . The communication system of claim 31 , wherein the 
symbol constellation is formed using a PAM- 1 6 constellation 
comprising the set of constellation points {-1 .84, -1.42, 1.84, 
-1.11, -0.40, -0.65, -0.29, -0.83, 1.11, 0.84, 1.42, 0.65, 
0.05, 0.29, -0.05, 0.40}. 





